R Notebook

Warning: package ‘rvest’ was built under R version 4.1.2
Warning: package ‘syuzhet’ was built under R version 4.1.2
Warning: package ‘sentimentr’ was built under R version 4.1.2
Registered S3 method overwritten by 'data.table':
  method           from
  print.data.table     

Attaching package: ‘sentimentr’

The following object is masked from ‘package:syuzhet’:

    get_sentences

Warning: package ‘gplots’ was built under R version 4.1.2

Attaching package: ‘gplots’

The following object is masked from ‘package:stats’:

    lowess

Warning: package ‘tm’ was built under R version 4.1.2
Loading required package: NLP
Warning: package ‘NLP’ was built under R version 4.1.1
Warning: package ‘factoextra’ was built under R version 4.1.2
Loading required package: ggplot2

Attaching package: ‘ggplot2’

The following object is masked from ‘package:NLP’:

    annotate

Welcome! Want to learn more? See two factoextra-related books at https://goo.gl/ve3WBa
Warning: package ‘beeswarm’ was built under R version 4.1.1

Attaching package: ‘scales’

The following object is masked from ‘package:syuzhet’:

    rescale

Warning: package ‘RANN’ was built under R version 4.1.2
Warning: package ‘topicmodels’ was built under R version 4.1.2

Text mining

A tenant at will, who possesses land sufficient to maintain his family for little more than a quit rent, is as dependent upon the proprietor as any servant or retainer whatever, and must obey him with as little reserve. Such a proprietor, as he feeds his servants and retainers at his own house, so he feeds his tenants at their houses. The subsistence of both is derived from his bounty, and its continuance depends upon his good pleasure.

Text basic processing

Adapted from https://eight2late.wordpress.com/2015/09/29/a-gentle-introduction-to-topic-modeling-using-r/.

[1] "Sample sentence:"
Prison Reform: for the benefit of the working class. This is the last word and the only seriously meant word of bourgeois Socialism. It is summed up in the phrase: the bourgeois is a bourgeois for the benefit of the working class.
[1] "After converting to lower case:"
prison reform: for the benefit of the working class. this is the last word and the only seriously meant word of bourgeois socialism. it is summed up in the phrase: the bourgeois is a bourgeois for the benefit of the working class.
[1] "After removing punctuation:"
prison reform for the benefit of the working class this is the last word and the only seriously meant word of bourgeois socialism it is summed up in the phrase the bourgeois is a bourgeois for the benefit of the working class
[1] "After removing numbers:"
prison reform for the benefit of the working class this is the last word and the only seriously meant word of bourgeois socialism it is summed up in the phrase the bourgeois is a bourgeois for the benefit of the working class
[1] "After removing stopwords:"
prison reform   benefit   working class    last word    seriously meant word  bourgeois socialism   summed    phrase  bourgeois   bourgeois   benefit   working class
[1] "After removing whitespace:"
prison reform benefit working class last word seriously meant word bourgeois socialism summed phrase bourgeois bourgeois benefit working class
[1] "After stemming:"
prison reform benefit work class last word serious meant word bourgeoi social sum phrase bourgeoi bourgeoi benefit work class

Topic modeling

Generate document-term matrices.

Run LDA

Warning: file ‘LDAGibbs_8_DocsToTopics.csv’ has magic number '"","V'
  Use of save versions prior to 2 is deprecated
Error in load("../output/LDAGibbs_8_DocsToTopics.csv") : 
  bad restore file magic number (file may be corrupted) -- no data loaded

The most popular and salient terms for each topic:

Topic 1	Topic 2	Topic 3	Topic 4	Topic 5	Topic 6	Topic 7	Topic 8
form	perfect	duti	interest	price	whole	polit	year
surplus	superior	europ	term	quantiti	stock	question	hour
process	sovereign	home	expect	land	anoth	struggl	factori
constant	exercis	compani	unit	tax	maintain	movement	hous
accumul	servic	commerc	level	proport	fund	bourgeoi	half
mode	educ	wine	margin	rent	want	revolutionari	children
variabl	offic	prohibit	output	rise	divid	democrat	million
labour	peopl	countri	will	price	can	state	work
valu	law	upon	interest	produc	part	social	time
product	even	great	rate	quantiti	differ	class	year
capit	govern	trade	employ	money	must	polit	one
commod	public	good	increas	profit	employ	econom	day
power	everi	manufactur	wage	land	one	worker	hour
form	common	import	money	tax	whole	develop	two
mean	like	part	capit	will	may	industri	factori

Clustering of topics

[1] "Production"        "Politics"          "Trade"             "Finance & Banking" "Property"         
[6] "Assets"            "Socioeconomics"    "Time"             

Mind and body. Cartesian - duality between mind and body. justice, good, mind. male vs female, feminism - wollstonecraft. naturalism. religion, god. Deontolgy and consequentialsm. location. free will. society vs self. females focused more on society

good harm action